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DYNAMIC IMAGH PROCESSING METHOD, DYNAMIC IMAGE 

i 

5 PROCESSOR AND DYNAMIC IMAGE DISPLAY DEVICE 

BACKGROUND OF THE INVENTION 

1. Field of the. Invention 

10 The present invention relates to a dynamic image processing 

method, a dynamic image processor, and a dynamic image display device. 

2. Description of the Related Art 

As recent development of computer games and progress of 
15 computer graphics technology have been on the increase, various images 
and TV are displayed on a computer display device. Such images may 
include dynamic images which exhibit a laige and high speed variation in 
brightness over time, for example, glaring dynamic images with high speed 
motions and intensive flashes. Such dynamic images provide a stress to a 
20 viewer who looks the display screen. It has been confirmed that such 
images cause a video display terminal stress which may cause a light 
sensibility trouble of the viewer. 

The brightness variation over time at a frequency band from 
about 7Hz to 60Hz including IOH2 is particularly sensible, to the human. 
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Japanese laid-open patent publication No. 2795214 discloses that to 
countermeasure the above problem, a tiine-ftlter is used to the dynamic 
image signal with the above brightness variation. The influence by the 

variation in brightness over time is reduced as follows. The variation in 

i 

brightness signals or RGB-signals over time are processed by the time filter 
to attenuate a frequency component in the above influential frequency band 

1 

for reducing the excessive stress to the viewer. Each of the RGB-signals 
may optionally be converted from analog signals to digital signals, so that 
the brightness of the digital signals or respective signal values are. then 
processed by the time-filter. The most sensible frequency to the human may 
be confirmed by displaying white-and-black flashes over a gray- 
background with variations in contrast between white and black and in 
frequency. 

The variation in brightness over time of the entirely of the image 

i 

is extracted, so that only if the extracted variation exceeds a predetermined 

value, then the time filter processing is executed. The image may be 

! 

represented by the analog or digital signals. The magnitude of variation in 
brightness over time or the magnitude of variation in RGB-signal values is 
integrated over an entirety of the display screen, so that a magnitude of the 
attenuation is adjusted in accordance with the integrated magnitude value. 

A difference in brightness between a moving object of the 

i 

dynamic image and the background image is detected. Namely, all of the 
moving objects are uniformly subjected to the time-filter independent from 
a displacement of the object with reference to a visual field and a relative 

! 
i 
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speed to the visual field. 

The recognition of the object moving ovei the dynamic image may 

i 

be made by either an inter-frame differential coding method, a moving 

vector detecting method and a gradient method. Those methods may be 

i 

5 optionally selected in consideration of the word load level, the hardware 

conditions, the quality of image and costs. 

i 

The above-described conventional technique is to subject moving 
objects to the uniform time-filtering process, whereby edges of the object 
on the image are non-shanp, and the motion of the object makes the viewer 
10 to feel not natural Thereto. 

In the above circumstances, the development of a novel dynamic 

image processing method, a dynamic image processor and a dynamic 

i 

image display device free from the above problems is desirable. 
15 ' SUMMARY OF THE INVENTION 

i 

Accordingly, it is an object of the present invention to provide a 
novel dynamic image processing method free from the above problems. 

It is a further object of the present invention to provide a novel 

i 

20 dynamic image processing method which may subject the moving object to 
the time-filtering process for attenuation to the- variation in brightness over 
time of the. dynamic image without causing the viewer to feci unnatural to 
the motion of the moving object over the dynamic image. 

It is a still further object of the present invention to provide a 

1 

j 
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novel dynamic image processor tree from the above problems. 

Tr is yet: a further object of the present invention to provide a 
novel dynamic image piocessoi which may subject the moving object to 
the time-filtering process for attenuation to the variation in brightness over 
5 time of the dynamic image without causing the viewer to feel unnatural to 
the motion of the moving object over rhs dynamic image. 

It is a still further object of the present invention to provide a 
novel dynamic image display device free from the above problems. 

It is yet a further object of the present invention to provide a 
10 novel dynamic image display device which may subject the moving object 
to the lime-filtering process for attenuation to the variation in brightness 
over time of the dynamic image without causing the viewer to feel 
unnatural to the motion of the moving object over the dynamic image. 

The present invention provides a method or a processor for 
15 filtering process for attenuation to a frequency component in a designated 
frequency band of a frequency of variation of a dynamic image by 
detecting the moving object ; and .snbjecring at least a part of the moving 
object to a modified filtering process with at least a reduced attenuation or 
without attenuation and also subjecting a remaining part of the moving 
20 object to a normal filtering process with a non-reduced attenuation which is 
larger j"n magnitude than the reduced attenuation. 

The above and other objects., features and advantages of the 
present invention will be apparent from the following descriptions. 

, Page 4 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Preferred embodiments according to the present invention will be 
described in detail widi reference Lo die accompanying drawings. 
5 FIG. 1 is a block diagram illustrative of a dynamic image 

processor in a first embodiment in accordance with the present invention. 

FIG. 2 is a flow chart illustrative of operations of the dynamic 
image processor of FIG. 1. 

ft v_/ 

J ~ J FIG. 3 is a block diagram illustrative of internal structures of the 

tp 10 image memory unit and the motion detecting unit included in the dynamic 

83 

Cii image processor shown in FTG. 1 . 

FIG. 4 is a view illustrative of Operations of the motion detecting 
ti, unit in co operation with the image memory unit. 

H FIG. 5 is a block diagram illustrative of internal, structures of the 

f| 15 image memory unit and the time-filtering processing unit included in the 

r * dynamic image processor shown in FIG. 1. 

v w . FIG. 6 is a flow chart of operations of the time-filtering 

processing unir included in the dynamic image processor in a second 
embodiment in accordance with the yicscul invention. 
20 FIG. 7 is a flow chart of operations of the timc-filtcring 

processing unit included in the dynamic image processor in a third 
embodiment in accordance with the present inversion. 

FIG. 8 is a block diagram illustrative of a dynamic image 
processor in a fourth embodiment in accordance with the present invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

A first aspect of the present invention is a method of filtering 
5 process for attenuation to a frequency component in a designated frequency 
band of a frequency uf variation of a dynamic image. The method 
comprises the step of : detecting the moving object ; and subjecting at least 
a part of the moving object to a modified filtering process with at least a 
reduced attenuation and also a remaining part of the. moving object to a 
10 normal filtering process with a non-reduced attenuation which is larger in 
magnitude than the reduced attenuation. 

It is possible that an entirety of the moving object is uniformly 
subjected to the modified filtering process. 

It is possible that the moving object is extracted depending on at 
15 least one factor of a size, a shape, a brightness, a color and a moving speed 
of The object. 

It is pussiblc thai the reduced auenualion is fixed at a single 
magnitude of the attenuation. 

It is possible that the reduced attenuation is selected from plural 
20 different mapnimdes of the attenuation. 

li is possible that the reduced attenuation is set at an optional 

value. 

It is possible to further comprise the step of : decoding a 
compressed dynamic: image, data prior ro defecting the moving object based 
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on the decoded dynamic image data. 

A second aspect uf the present invention is a method nf filtering 
process for attenuation to a frequency component in a designated frequency 
band of a frequency of variation of a dynamic image. The method 
5 comprises The step of : detecting the moving object ; and subjecting at least 
a part uf the moving object to a modified filtering process with no 
attenuation and also a remaining part of the inuvhig object to a normal 
filtering process with a predetermined attenuation. 

It is possible that an entirety of the moving object is uniformly 
10 subjected to the iuudified filtering process. 

It is possible that the moving object is extracted depending on at 
least one factor of a size, a shape, a brightness, a color and a moving speed 
of the object. 

It is possible to further comprise the step of : decoding a 
15 compressed dynamic image data prior to detecting the moving object based 
on the. decoded dynamic image data. 
^ A third aspect of the present invention is a processor for 

processing a dynamic image including : a motion detector for detecting a 
moving object which moves over the dynamic image ; and a time-filter 
20 processing unit for attenuation to a frequency component in a designated 
frequency band of a frequency of variation of a dynamic image, wherein 
the time-filter processing unit further includes a filtering-process control 
unit which subjects at least a part of the moving object to a modified 
filtering process with at least a reduced attenuation and also subjects a 
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remaining part of the moving object ro a normal filtering process with a 

i 

non-reduced attenuation which is larger in magnitude than the reduced 
attenuation. 

j 

It is possible that the filtering-process control unit uniformly 
5 subjects an entirety of the moving object to the modified filtering process. 

It is possible rbar the motion detector detects the moving object 
depending on at least one facloi of a size, a shape, a brightness, a color and 
a moVing speed of the object. 

It is possible that the filtering-process control unit sets the 

i 

10 reduced attenuation at a single magnitude of the attenuation. 

i 

IL is possible that the filtering-process control unit selects the 
reduced attenuation from plural different magnitudes of the attenuation. 

It is possible that the filtering-process control unit sets rhe 

i 
I 

reduced attenuation at an optional value. 

I 

15 It is possible to further include a compression data decoder for 

decoding a compressed dynamic image data so that the motion detector 
detects the moving object based on the. decoded dynamic image data. 

A fourth aspect of the present invention is a processor for 
processing a dynamic image including : a motion detector for detecting a 

i 

20 moving object which moves over the dynamic image ; and a time-filter 
processing unit tor attenuation to a frequency component in a designated 
frequency band of a frequency of variation of a dynamic image, wheiein 
the time-filter processing unit further includes a filtering-process control 
unit which subjects at least a part of the moving object to a modified 



Pare 8 



'01 11 /30 FRI 00:33 FAX 03 3102 1660 J\7F 3774 1^3:/ i,va 



Pf-290i/r>ec,Wmh 

I 
i 
i 
I 
| 

filtering process without attenuation and also subjects a remaining part of 

the moving object to a normal filtering process with a predetermined 

i 

attenuation. 

It is possible that the filtering-process control unit uniformly 

i 

5 subjects an entirety of the moving object to the modified filtering process. 

It is possible that the motion detector detects the moving object 
depending on at least one factor of a size, a shape, a brightness, a color and 
a moving speed of the object. 

It is possible to further include a compression data decoder for 

i 

10 decoding a compressed dynamic image data so that the motion detector 

i 

detects the moving object based on the decoded dynamic image data. 

A fifth aspect of the present invention is a display device for 

processing a dynamic image including : a motion detector for detecting a 

i 

moving object which moves over the dynamic image ; a time-filter 
15 processing unit for attenuation to a frequency component in a designated 
frequency band of a frequency of variation of a dynamic image ; and a 

display unit for displaying a dynamic image based on a dynamic image 

i 

signal which has been processed by the time-filter processing unit, wherein 

the time-filter processing unit further includes a filtering-process control 

i 

20 unit which subjects at least a part of the moving object To a modified 

i 

filtering process with at least a reduced attenuation and also subjects a 
remaining part of the moving object to a normal filtering process with a 
non-reduced attenuation which is larger in magnitude than the reduced 
attenuation. 
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It is possible that the filtering-process control unit uniformly 
subjects an entirety of the. moving object to the modified filtering process. 

It is possible that the motion detector detects the moving object 
depending on at least one factor of a size, a shape, a brightness, a color and 
5 a moving speed of the object. 

It is possible that the filtering-process control unit sets the 
reduced attenuation at a single magnitude of the attenuation. 

It is possible that the filtering-process control unit selects the 
reduced attenuation from plural different magnitudes of the attenuation. 
10 It is possible that the filtering-process control unit sets the 

reduced attenuation at an optional value. 

It is possible to further include a compression data decoder for 
decoding a compressed dynamic image data so that the motion detector 
detects the moving object based on the decoded dynamic image data. 
15 A sixth aspeel of the present invention is a display device for 

processing a dynamic image including : a motion detector for detecting a 

! 

moving object which moves over the dynamic image ; a time-filter 
processing unit for attenuation to a frequency component in a designated 
frequency band of a frequency of vanation of a dynamic image ; and a 

20 display unit for displaying a dynamic image based on a dynamic image 

I 

signal which has been processed by the time-filter processing unit, wherein 
the time-fitter processing unit further includes a filtering-process control 
unit which subjects at least a part of the moving object to a modified 
filteiing process without attenuation and also subjects a remaining part of 
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the moving object to a normal filLering process with a predetermined 

attenujilion. 

i 

It is possible that the filtering-process control unit uniformly 

! 

subjects an entirety of the moving object to the modified filtering process. 

5 It is possible that the motion detector detects the moving object 

I 

depending on at least one factoj of a size, a shape, a brightness, a color and 

a moving speed of the object. 

i 

It is possible to further include a compression data decoder for 

decoding a compressed dynamic image data so that the motion detector 

i 

10 detect:? the moving object based on the decoded dynamic image data. 

FIRST 1 EMBODIMENT: 

i 

A first embodiment according to the present invention will be 
described in detail with reference to the drawings. FIG. 1 is a block 
15 diagram illustrative of a dynamic image processor in a first embodiment in 

accordance with the present invention. A dynamic image processor 8 

! 
i 

includes an input data converting unii 1, an image memoiy unit 2, a motion 
detecting unit 3, a time-filtering processing unit 4, an output data 
converting unit 5, a display unit 6, and a control unit 7. 
20 The input data converting unit 1 receiver an input of a dynamic 

image signal and converts the a dynamic image signal into a data format for 

i 

the image processing. The input data converting unit 1, for example, 

i 

performs an analog-to-digital conversion for converting an analog dynamic 

! 

image signal into a digital dynamic image signal. The image memory unit 2 
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! is electrically coupled to the input data converting unit 1 for receiving the 

digital dynamic image signal from the input data converting unit 1. The 
image memory unit 2 is also electrically coupled to the time-filtering 

processing unit 4 for receiving a digital dynamic image signal on the time- 

i i 

! 5 filtering process from the time filtering processing unit 4. The image 

I memoTy unit 2 stores plural frames of the digital dynamic image signals in 

j frame junits. 

The motion delecting unit 3 is electrically coupled to the image 
memory unit 2 for reading the image in the frame unit out from the image 

10 memory unit 2 and detecting a moving object over frames. The rime- 
|| filre.ring processing unit 4 is electrically coupled to the image memory unit 

jj= 2 and also to the motion detecting unit 3 for attenuating a frequency 

S J component in a predetermined frequency band of a frequency, at which an 

ft dynamic image varies over time. The. output data converting unit 5 converts 

15 the fi'lier-processed digital dynamic image data into a dynamic image 
^ signal. 

The display unit 6 is electrically coupled to the time-filtering 
i processing unit 4 for receiving an information of the attenuation to the 

signals by the time-filtering processing unit 4 and converts an intensity of 
! 20 stress to a human by the dynamic image into values through a 

predetermined operation expression based on the attenuation for displaying 
| the same. The controJ unit 7 is electrically coupled to the input data 

; converting unit 1. the image memory unit 2. lhe motion detecting unit 3, 

the Linie-filtciiiig processing unit 4, the output data converting unit 5, and 
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the display unit 6 for controlling operations in timings thereof. The control 
unit 7 also includes a filtering control unit for controlling the filtering 
process of the time-fillering processing unit 4. 

If the inputted dynamic image signal is an interlaced dynamic 
5 signal such as a TV broadcasting data, then under the control by the control 
unit 7, odd number frames and even number frames are separately stored 
into the image memory unit 2, so thai the udd number frames and the even 
number frames are then processed separately. The time-filtering processed 
odd and even number frames are synthesized under the control by the 
10 control unit 7 for subsequent transmission of the synthesized dynamic 
image data to the output data cunverling unit 5. 

The dynamic image processor 8 is electrically coupled to a 
dynamic image display unit 9 which displays the dynamic image based in 
the. dynamic image signal supplied from the dynamic image processor S. 
15 The dynamic image display device comprises the dynamic image processor 
8 and the dynamic image display unit 9. The dynamic image display unit 9 
may be realized by any available display device such as a cathode ray tuhe 
(CRT), a liquid crystal display device and a projector. 

Operations of the dynamic image processor 8 will be described. 

20 FIG. 2 is a flow chart illustrative of operations of the dynamic image 

i 

processor of FIG. 1. In a step SI I), the dynamic image signal is inputted 

i 

into the. input data converting unit 1, wherein the dynamic image signal 
may, Tor example, be National Television System Committee System TV 
signal. In a step Sll, the input data converting unit 1 converts the inputted 
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! 

dynamic image signal into digital dynamic image data, for example, 8-bits 

i 

RGB data. In a step S12, the image memory unit 2 sequentially stores the 

i 

digital dynamic image data in frame unit which have, been sequentially 

outputted from the input data converting unit "1. In a step S13, the motion 

i 

5 detecting unit 3 reads the digital dynamic image data out from the image 
memory unit 2 and detect an inter-framc difference signal for detecting the 
moving object, so that the motion detecting unit 3 supplies the time- 
filtering processing unit 4 with a dynamic image mask signal which makes 

i 

an image region, through which the object has moved, into a mask region 
10 which is not subjected to the time-filtering process. 

In a step S1A, the time-filtering processing unit 4 reads the digital 

dynamic image data from the image memory unit 2 and performs the time- 

i 

filtering process to the image region which is not masked by the dynamic 

image mask for attenuation of the frequency component in the 

i 

15 predetermined frequency band of the frequency of the brightness variation 

i 
i 

of the dynamic image. The region masked by the dynamic image mask is 

not subjected to the time-filtering process. The above described operations 

i , 
arc performed under the control of the filtering control unit included in the 

control unit 7. The timing control tor masking the time-filtering process by 

20 the dynamic image mask signal is conducted by the control unit 7. 

Detailed sliuctujcs and operations of the motion detecting unit 3 
and the time-filtering processing unit 4 will be described later. 

In a step S15, the output data converting unit 5 converts the timf.- 
filtered digital dynamic image riarn into the dynamic image signal in the 

! 
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predetermined format. In a step S16, the output data convening unit 5 
outputs the, dynamic image signal. The dynamic image display unit 9 
receives the dynamic image signal and displays the time filtered dynamic 

i 

image. The time-filtering process is made in consideration of the moving 

| 

5 object with preventing the viewer from feeling unnatural to the moving 
object over the dynamic image. 

The intensity of the stress to the human body by the dynamic 
image, which is on the time-filtering process, is displayed on the display 
unit 6 with numerical expression which is obtained from the operation of 

10 the. time-filtering processing unit 4. This quantization operation or the 

i 

numerical cApiession will be described later in detail. Tt is possible as a 
modification that the dynamic image processor 8 is free of the display unit 
6, and the above numerical value is processed by On-Screen-Display 
Process and added to the dynamic image signal for displaying the same 

15 with character informations on a selected area of the screen of the dynamic 
image display unit 9. 

Structure, and operations of the motion detecting unit 3 in 
cooperation with the image memuiy unit 2 will be described. FIG. 3 is a 
block diagram illustrative of internal structures of the image memory unit 

20 and the motion detecting unit included in the dynamic image processor 
shown in MG. 1. 

The image memory unit 2 includes a fiist Haaie memory 21, a 
second frame memory 22. and a third frame memory 23. The first frame 

memory 21 stores the inputted digital dynamic image signal. The second 

| 
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i 

frame memory 22 stores the digital dynamic image signal supplied from the 

first frame memory 21. The third frame memory 23 stores the digital 

I 

dynamic, image signal supplied from the second frame memory 22. 

The motion detecting unit 3 includes a first differential image 
5 processing unit 31, a second differential image processing unit 32, a first 
binary image processing unit 33. a second binary image processing unit 34, 
and a dynamic image mask data creating unit 35. The first differential 
image processing unit 31 operates a first differential image Bl x ,y(t) from 
the digital dynamic image signals from the first and second frame 

10 memories 21 and 22. The lecond differential image processing unit 32 

j 

operates a second differential image B 2 x ; y(t) from the digital dynamic 
image' signals from the second and third frame memories 22 and 23. 

The first binary image processing unit 33 compares the first 

i 

differential image Bl Xj y(f) supplied from rhe first differential image 

i 

15 processing unit 31 to a designated thresliuld value foi converting the first 
differential image Blx,y(t) into a first binary image G(B- l X) y(t)). The 

second binary image processing unit 34- compares the second differential 

I 

image B2 Xj y(t) supplied from rhe second differential image processing unit 
32 to a designated threshold value fuj converting the second differential 
20 image B2 x> y(t) into a second binary image G(B2 X y(t)). The dynamic 
image mask data creating unit 35 operates a logic-AND of the first binary 
image G(Bl x .v(t)) supplied from rhe. firsr binary image processing unit 33 
and the second binary image G(B2 X y(l)) supplied from the second binary 
image processing unit 34 for creating a dynamic image mask data C Xj y(t-l) 
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and onrputring the dynamic image mask signal. Tlie dynamic image mask 
data ci eating unit 35 uses the following equation for the AND operation. 
C X; y(M) = G(Bl x , y (t)) f"t G(B2 Xjy (t)) 

Operations of the motion detecting unit 3 in co-operation with 
5 the image memory unit 2 will subsequently be described. FIG. 4 is a view 

illustrative of Operations uf the motion detecting unit in co-operation with 

I 

the image memory unit. A moving object is a car. It is assumed that the first 
frame memory 21 has stored a first frame T Xj y(t-2), the second frame 
memory 22 has stored a second frame l x .y(l-l), and the third frame 
10 memdry 23 has stored a third frame Ix,y(t). 

The motion detecting unit 3 shows the following operations to 

! 

calculate the dynamic image mask data. The first differential image 
processing unit 31 operates a first differential image Bl X; y(0 from the 

digital dynamic image signals from the first and second frame memories 21 

i 

15 and 22. The second differential image processing unit 32 operates a second 
differential image B2 Xj y(t) from the. digital dynamic image, signals from the 
second and third frame memories 22 and 23. The fiist binary image 
processing unit 33 compares the first differential image Bl x ,y(t) supplied 
from the first differential image processing unit 31 to a designated 

20 threshold value for converting the first differential image Rl X; y(t) into a 
first binary image G(Bl Xj y(t)). The second binary image processing unit 34 
compares the second differential image B- X; y(t) supplied from the second 
differential image processing unit 32 to a designated threshold value for 

converting the second differential image B2 Xj y(t) into a second binary 

i 
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image G(B2 X; y(t)). The dynamic image mask data creating unit 35 operates 
a logic-AND of the first binary image G(Bl A .y(t)) supplied from the first 
binary image processing unit 33 and the second binary image G(B2 X) y(t)) 

supplied from the second binary image processing unit 34 for creating a 

i ... 
5 dynamic image mask data Cx,y(t-1) and outputting the dynamic image 

mask signal. The cross hatched region represents the mask region which is 

inhibited for the timc-filtcring process. 

In accordance with the present embodiment, the. motion is 

i 

detected based on a difference in brightness. It is also possible as a 
10 modification that the motion is detected based on a difference in color. It is 



detected based on a 
areri from a moved 
present embodiment, 



also possible as a modification that the motion is 

difference in moving speed which has been calcn 

i 
i 

distance of the moving object. In accordance with the 
the moving object is detected based on the intcr-frame differential coding 
15 method. It is also possible as a modification that the moving object is 

! 

i 

detected based on a morion vector which has been extracted from a 
determined correspondent pixel between the frames. There is also available 
a gradient method for extracting a time variation in a jpatial gradient of the 

spatial device of the frame and calculating the motion vector based on the 

] 

20 time variation in the. spatial gradient. Other available methods for detecting 
i | 
the moving object may be optiunal. It is fuithcf possible as a modification 

i 

that each of the first and second binary image processing units 33 and 34 
has an additional function to eliminate a noise by a scaling process. 

One example, of the method of creating the dynamic image mask 
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I 

signal from the dynamic image mask data will be described. The time- 
filtering processing unit 4 reads the image from the image memory unit 2. 

The time-filtering process is started from the left top pixel on the screen. In 

i 

synchronizing with the timing of processing the image data at the pixel, the 
5 dynamic image mask data are red out to create the dynamic image mask 

signal! The non-crosshatched region which is to be time-filtered is read as 

i 

the "H" level, and the crosshatched region which is to be not lime -filtered 

i 

is read as the "L" level. The "L" level signal representing the non-timc- 
filtering region is inputted into the time filtering processing unit 4, then the 
10 time-filtering processing unit 4 does not perform the time-filtering process 
or does artjnsr rhe attenuation to the frequency component based uu the "L" 

! 

level signal. 

I 

The time-filtering process will be described. FIG. 5 is a block 

diagram illustrative of internal structures of the image memory unit and the 

15 time-filtering processing unit included in the dynamic image processor 

... 

shown in FIG. 1. The time-filtering processing unit 4 includes a first 

arithmetic processing unit 41 on a first stage, a second arithmetic 

! 

processing unit 42 on a second stage, a third arithmetic processing unit 43 
on a third stage, and a fourth arithmetic processing unit 44 on a fourth 

20 stage. 1 

i 
i 

The image memory unit 2 includes a first frame memory 81 for 

i 

storing a first frame Ix,y(t), a second frame memory 82 for storing a second 
frame Al x ,y, a third frame memory S3 for storing a third frame A2 Xj y, a 
fourth f i tune memory 84 for storing a fourth frame A3 x .y, and a fifth frame 



j 
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i 
i 

memory 85 for storing a fourth frame A^x.y, as well as a first dynamic 

i ' 

image mask data memory 91 for storing a first dynamic image mask data 

i 

CJ-x,yt't): q second dynamic image mask data memory 92 for storing a 
second dynamic image mask data C 2 Xj y(M), a third dynamic image mask 
5 data memory 93 for storing a third dynamic image mask data C3 X! y(t-2), 
and a fouith dynamic image mask data memory 94 for storing a fourth 
dynamic image mask data C 4 x ,y(t 3). The first to fourth dynamic image 

mask data memories 91, 92, 93 and 94 sequentially store the dynamic 

i 

image mask data created by the motion detecting unit 3. The string of the 
10 data is the dynamic image mask signal which controls the time filtering 

processing unit 4 . 

i 

In order to perform the time-filtering process in brightness 

i 
i 

between the frames uf the pixels, the plural frame memories 81-85 arc 

j 

connected in scries to each other to form a multi-stage. The number of the 
15 multistage corresponds to the number of the stage of the time-filter. The 

number of the stage of the time-filter is a parameter fur adjusting the 

i 

filtering effect and the smoothness of the processed images over time. In 
consideration of the effect of the filter and the cost, the number of the stage 
may oe preferable at 10 or less. The time-filtering process may, for 
20 example, use the four-stages. The first to fourth arithmetic piucessing units 

41. 42, 43 and 44 connected to the corresponding frame memories 81-85 

I 

form the four stage filter functions. The dynamic images are inputted in the 
frame unit are processed by the multi-stage filtering functions for obtaining 
a smooth filtering process. The dynamic image mask signal controls the 
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! 
j 

time-filtering prucess to the moving object. 

On the first stage filter, the first arithmetic processing unit 41 
receives the image data l Xj y(f) in the first frame, memory SI, the frame data 
Al X; y(t-l) stored in the second frame memory 82 and previously operated 
5 by the first arithmetic processing unit 41, the mask data C^jCO stored in 

the first mask data memory 91, and a current time-constant r (t), so that the 

I 

first arithmetic processing unit 41 operates the following equation to obtain 
the frame data A"l x ,y(t) 

Al x ,y(t) = i (t) A^yO-l) + (1- V (t)) Ixj(L), piovided that 

10 Cl* 3 y(t) = 1 

1 

Al x ,y(0 = lx,y(0, provided that Cl x , y (t) = 0 

The first arithmetic processing unit 41 writes the image data 

a! x y(t) into the second frame memory 82. 

\ 

C^x,y(t) = 1 corresponds to the cross-hatched region of the 

15 moving object, where the cross-hatched region corresponds to the. "L" level. 

i 

C^x,y(0 = 0 corresponds ro the non-cross-hatched region of the moving 
object, wheie the non-cross-hatched region corresponds to the "II" level. 
The control unit 7 has a filtering-process control unit for controlling the 
arithmetic operations by the first to fourth arithmetic processing units 4.1- 
20 44 based on the. mask data Cl Xj y(r), C.2 x?y (M ), c3 Xj y([-2), and C 4 x 7 y(t-3). 

The time constant V (l) is a time constant of the time-filtering 

i 

process which is set depending on the brightness variation of the entirety of 
the image in the single frame, which may corresponds to the magnitude of 

the visual stimulus to the human. This time constant may be set to each 

i 
i 
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stage of the filler. The calculation of the time constant is made by the time 

i 

filtering processing unit 4, wherein the time-filtering processing unit 4 
further includes a brightness variation extracting unit for obtaining a 
variation in brightness of the image. The brightness variation extiacting 

5 unit fetches the last frame data and the image data for calculating the 
tliicshuld value from the image memory unit 2, and finding a difference in 
brightness value between bot images at the same pixel, and summing the 
differences over all the pixels. The sum value normalized in maximum 
brightness of the image to find an effective attenuation E(t). The function 

10 of the time constant for the time-filtering is set based on the magnitude of 
the effective attenuation E(t). Constant included in the Junction of the. time, 
constant may be selecred clinically. Plural constants may optionally be i>el 
for the purpose of clinical text to the light-sensible trouble. This constant 

may alternatively be set at an optional value. The time constant r (t) and 

i 

15 the effective attenuation H(t) arc disclosed in Japanese, patent No. 279521 4. 

For allowing the display unit 6 to numerically display the 
intensity of the stress to the human by the dynamic image, it is possible to 
use the time constant f (t) and the effective attenuation E(t). A difference in 
the effective attenuation £(t) between after and before, the time-filtering 

20 processes is found to numerically represent an effect of the time-filtering 
process and display the effect on the display unit 6. 

On the second stage filter, the second arithmetic processing unit 
42 receives the frame data Alx s y(t-1) stored in the second frame memory 
82 and the frame data A2 Xj y(t-l) stored in the third frame memory 83. the 
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I 
i 

mask data C?x,y(t 1) stored in the second mask data memory 92, and the 
current time-constant r. (t) 7 so that the second arithmetic processing unit 42 
operates the. following equation to obtain the frame data A 2 X j(t) 

A2 x ,y(t) = r (t) A 2 Xl y(t-D + (1- r (0) A^y(t), provided that 

5 C^ Xs y(t) = 1 

A 2 x,y(t) - Al x ,y(t), provided that C^t) = 0 

The. second arithmetic processing unit 42 writes the image data 

! 

A-x,y(0 into the third fiame memory 83. 

On the third stage filter, the third arithmetic processing unit 43 

10 receives the frame data A2 X) y(t-l) stored in the third frame memory 83 and 
the frame data A 3 x ,y(t-1) stored in the fourth frame memory 84, the mask 
dala C 3 x,y(t-2) stored in the third mask data memory 93, and the current 
time constant Z (t), so that the third arithmetic processing unit 43 operates 
the following equation to obtain the frame data A3 X)V (t) 

15 A 3 x,y(0 ='(0 A 3 x,y(H) + O " (0) A 2 X; y(t), provided that 

C 3 Xl y'(t) = 1 

i 

A 3 X)V (t) = A2 Xjy (t) 3 provided that c3 x>Y (t) = U 

I 

The third arithmetic processing unit 43 writes the image data 
A 3 x,y(t) into the fourth frame nicnioiy 84. 
20 On the fourth stage filter, the fourth arithmetic processing unit 44 

receives the frame data A3 X)V (t-l) stored in the tourth frame memory 84 

j 

and the frame data A4 XjV (t-l) stored in rhe fifth frame memory 85, the 
mask data C4 Xj y(t-3) stored in the fouiih mask data memory 94, and the 
current time-constant r (t), so that the fourth arithmetic processing unit A\ 
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operates the following equation lo obtain the frame data A 4 x.y(0 

A 4 X! y(t) = r(t) A 4 x, y (t-1) + (l-r(t)) A\ y (t), provided that 

C 4 x,y(t) - 1 

i 

A 4 x,y(t) = A\y(t), provided that C 4 x>y (t) = 0 
5 The fourth arithmetic processing unit 44 writes the image data 

A 4 x 3 y(0 into the fifth frame memory 85. 

It is optionally possible that the first to fourth arithmetic 

i 

processing units 41-44 operate, pseudo-parallel processings. 

As described above, the time-filtering processing unit 4 operates 
10 the time-filtering process under the control of the dynamic image mask 
signal. In accordance with the above embodiment, the time-filtering 
process is made to the brightness. The time-filtering process may be made 
lo Red, Green and Blue sepaiately or to selected one or two of Red, Green 
and Blue. The time-filtering process may also be made with different 

15 respective attenuations to Red, Green and Blue. The time -filtering process 

i 

may a'lso be made to other color than Red, Green and Blue. 

j 

SEC OND EMBODIMENT: 

A second embodiment according to the present invention will he 

i 

20 described in detail with reference to the drawings. In the first embodiment, 

i 

the filtciiug effect is not applied to the moving object. In the second 
embodiment, however, an attenuated filtering effect is applied to the 
moving object. The arithmetic processing unit on the "j-th" stage operates 
in the| following equations. 



i 
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Aj XJ (l) = r (t) AJx,y(t-l) + (1- r (t)) AM x ,v(t), provided that 

a'x,y(j) = 1 (1) ' 

Ai x .y(l) = qA)-lx 3 yW + (1-q) { r(t) A) Xj y(M) + (1- V(t)) AJ" 
l X) y(tj}, provided that Cj 4 Xj y(0 = 0 "— ( 2 ) 

' FIG. 6 is a flow chart of operations of the time-filtering 
processing unit included in the dynamic image processor in a second 
embodiment in accordance with the present invention. 

In a step S61, image data are inputted by the input data 
converting unit 1 intu the time-filtering processing unit 4. In a step S62, the 
time-filtering processing unit 4 sets the time constant z (t). In a step S63, 
the motion detecting unit 3 extracts the moving object to create the 
dynamic image mask daia. In a step S64, a dynamic image mask signal is 
created from the dynamic image mask data, for judging the moving object 
which is masked from the time-filtering process. In a step S65, if it is not 

i 

the moving object, the time-filtering processing unit 4 calculates the image 
as attenuated using the time constant x (t) of the time-filter in accordance 
with the above equation (1). In a step S66, if it is the moving object, the 
time-filtering processing unit 4 sets a filter-control variable "q". Tn a step 
S67, the time-filtering processing unit 4 calculates the image as attenuated 
using the above equation (2). The calculated images arc synthesized to 

complete the time-filtering process. 

i 

The modified time-filtering process to the moving object is marie 

with subjecting the moving object to the control by the filleiing-control 

I 

variable "q", and the normal lime-filtering process is made to the other 
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image such as background image than the moving object. If the time-filter 
is the multi-stage time filler, then the lime constant r (t) may optionally be 
made iu cadi of the plural stages separately. It is also possible that the 
above 'steps 62 and 63 are concurrently made. 

5 | 

l l-iml) FMRODIMENT : 

A third embodiment according to the present invention will be 

i 

described in detail with reference to the drawings. In the third embodiment, 
either one of the specifically calculated time, constant i i(t) and the above 
10 normal time constant z (t) is selected for conducting the time-filtering 
process, whciein the specifically calculated time constant T l(t) is for a 
specific part of the masked region by the dynamic image mask signal. The 
time constant X i(t) may be calculated in accordance with the same 
f J equations as used for the time constant r (t), provided that the constant in 

W 15 t l ie equation is changed to an optional constant value, so that the time 

P constant v i(t) is different from the time constant r (t). The equation (1) is 

■ always used independent from whether d x ,y(t) = 0 or 1, provided that if 

rix.y(t) = 0, then the time constant r ft) is replaced by the time constant r 
| 1(0. ! 

j 20 FIG. 7 is a flow chart of operations of the rime-filtering 

processing unit included in the dynamic image processor in a third 
embodiment in accordance with the present invention. In a step S71, the 
' image data of a single frame are inputted by the input data converting unit 

' 1 into the time-filtering processing unit 4. In a step S72 : it is verified 
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whether the past image data is stored. 

If no past image data is stored, this means that the inputted data 
are the first data, then in a step S82, the control unit 7 stores the inputted 
image' data into the image memory unit 2 and also renders the inputted 
5 image data output from the time-filtering processing unit / 1. If the past 
image' data is stored, then in a step S73, the motion detecting unit 3 reads 
the image data from the image memory unit 2. In a step S74, the motion 
defecting unit 3 extracts the moving object based on the image data as read 
out and the image data as extracted, whereby dynamic image mask data are 
10 created and stored into the image memory unit 2. The control unit 7 reads 
the dynamic image mask data in synchronizing with the timing of the time- 

filteripg process, 10 create the dynamic image mask signal. In a step S75. 

i 

the time-filtering processing unit 4 sets the time constant X (t) of the time- 

i 

filter. In a step S76, the time-filtering processing unit 4 judges the masked 
15 region corresponding to the moving object based on the dynamic image 
mask signal. 

i . 

If no masked renion corresponding to the moving object is 
present, the time-filtering processing unit 4 performs the lime-filtering 
process with the time constant r (i) in a step S77. 1C the masked region 
20 corresponding to the moving object is present, the time-filtering processing 

unit 4 selects one of the time constant X (t) and the time constant V i(t). If 

i 

the time-filtering processing unit 4 selects the time constant r (t). then the 
time-filtering processing unit 4 performs the time-filtering process with the 

time constant r (t) in the step S77. If the time-filtering processing unit A 

I 
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i 

selects the time constant T i(t), then the time-filtering processing unit 4 

! 

converts the time constant Z (t) into the time constant X i(t) in the step S79. 
In a step the time-filtering processing unit 4 performs the time- 
filtering process with the time cuiibta.nl ' 1 (t). In a step S81, the time- 

i 

5 filtering processing unit 4 judges whether the time-filtering process for the 
one frame has been completed. If the time -filtering process for the one 
frame has not yet been completed, then the operation will back to the step 

S76\ If the time-filtering process for the one fiame has been completed, 

I 

then the time-filtering processing unit 4 output3 the image data for the one 

I 

10 frame which are then stored into the image memory unit 2 in a step S82. 

As described above., the selected moving object on the selected 
region is subjected to the modified time-filtering process at the time 
constant Z \(t) with no attenuation or reduced attenuation, whilst the non- 

i 

selected moving object on the other region than the. selected region and the 
15 background image are subjected to the normal lime-filteiing process at the 
Lime constant r (t), whereby the time-filtering processes may be made with 
the different time constants r (t) and t }(t) for evaluation on the intention 
of the VDT-strcss to the human by ihe moving object. The influence of the 
VDT-stress to the human may depend on the clinical data. For example, if 
20 the moving object has an area which is not less than 1/100 of the area of the 
screen, then the VDT-stress is considered to be high and the time-filtering 
process with the time constant r (t) is conducted. 

FOU km EMBODIMENT : 
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A fourth embodiment according 10 rhc present invention will be 
described in detail with reference lu the diav/ings. FIG. 8 is a block 
diagram illustrative of a dynamic image processor in a fourth embodiment 
in accordance with the present invention. In the fourth embodiment, the 
5 dynamic image processor 8 J further has a compressed-data decoding u nil 

101 in addition to The input data converting unit 1. the image memory unit 

I 

2, the moLion detecting unit 3, the time-filtering processing unit 4, the 
output data converting unit 5, the display unit 6, and the control unit 7. The 
compressed-data decoding unit 101 decodes the compression if the 
10 compressed dynamic, image data are inputted such as MPEG2. The 
compressed-data decoding unit 101 also recognizes the moving object and 

clips the moving object. The image memory unit 2 receives an information 

j 

about the moving object from the compressed-data decoding unit 101 for 
extracting me moving object more easily and surely. The dynamic image 

15 proceLoi 8 is icsponsible to the compressed data input. 

i 

Although the invention has been described above in connection 
with several preferred embodiments therefor, it will be appreciated that 
rho^e embodiments have been provided solely foi illusliating the invention, 

and not in a limiting sense. Numerous modifications and substitutions of 

i 

20 equivalent materials and techniques will be readily apparent to those skilled 

i 

in the art after reading the present application, and all such modifications 

and subsfitiiiinns are expressly understood to fall within the true scope and 

j 

spirit of the appended claims. 
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